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[57] ABSTRACT 

A method of splicing two compressed video signals which 
have been encoded according to the standard adopted by the 
Moving Picture Experts Group (MPEG) determines an 
amount of null information that is to be inserted between the 
two video signals in order to msure that an input buSer of 
an MPEG decoder does not overflow after receiving the 
spliced video signals. The method allows a splice to occur 
after any access unit (picbne) in the first compressed video 
signal. The amount of null information is detemuned fiom 
the data rates of the first and second coinpressed video 
signals and the amount of new data which is provided to the 
buffisr before the data is retrieved from the buffer for both the 
first and second video signals. The video signals are spliced 
by insertmg the null information, as sequHice stuffing bits 
into a buffer immediately after the selected pK:ture in the first 
video signal The second video signal is transmitted to the 
buffer imnudiately after these stuf&ng bits. 
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MEIHOD OF SPUCING MPEG ENCODED 
VTOEG 

This application is a continuation-in-pait of application 
Ser. No. 08/276.515 filed JuL 15. 1994. s 

BACKGROUND OF THE INVENHON 

Hiis invention concerns the processing of video signals 
encoded according to the standard adopted by the Moving 1° 
Picture Experts Group (MPEG) and in particolar, a mediod 
of splicing an MPEG encoded data stream from a first source 
to an MPEG encoded data stream fipom a second source in 
a manner that ensures that no video data is lost when the 
combined image is reproduced. 

In the United States a standard has been proposed for 
digitally encoded high deflnitioa television signals. This 
standard is essentially the same as the MPEG-2 standard, 
proposed by the Moving Picture Experts Group (MPEG) of 
the International Standards Organization (ISO). This stan- 
dard is described in a draft international standard (DIS) 
publication entitled 'Information Tbchnology — Generic 
Coding of Moving Pictures and Associated Aucho, Recom- 
mendation H.262" which is available from the ISO and 
which is hereby incorporated by reference for its teaching on ^ 
the MPEG-2 systems standard 'ISO/IEC 13818-1" and for 
its teachir^s on the MPEG-2 digital video encoding standard 
"ISQflEC 13818-2." 

The MPEG-2 standard is actually several different stan- ^ 
dards. In MPEG-2 several different profiles are defined, each 
conesponding to a different level of complexity of the 
encoded image. For each profile, different levels are defined, 
each level correqxmding to a dififexent Imqge resolution. 
One of the MPEG-2 "standards", known as Main Profile, 
Main Level is intended for encoding video signals conform- 
ing to existing television standards (i.e., NTSC and PAL). 
Another '^standard" known as Main Profile High Level is 
intended for encoding high-definidon television images. 
Images encoded according to the Main Profile, High Level ^ 
standard may have as many as 1,152 active lines per image 
frame and 1.920 pixels per line. It is this standard which is 
dirrcntly being implemented as the United States HDTV 
standard. 

The MPEG-2 standard defines a complex syntax which 45 
oontams a mixture of data and control information. Some of 
diis oonttol information is used to eiuible fiie signals having 
several different foimacs to be covered by the standard. 
These formats define images, having differing numbers of 
picture dements Qdxds) per line, differing numbers of lines 30 
per frame or field and differing numbers of firames or fields 
per second. In addition, the basic syntax of the MPEG-2 
Main Profile defines the compressed MPEG-2 bit stream 
representhig a sequence of images in six layers, the sequence 
layer, the group pictures layer, the picture layer, the slice 55 
layer, tilie macro block layer, and the block layer. Each of 
these layers is introduced with control information and 
"stuffing" characters. The stuffing characters are inserted as 
needed to ensure that the data rate of the input data stream 
matches the rate at which pictures are displayed. Finally, 
other control infoixnation, also known as side information, 
(eg. frame type, macroblock pattern, image motion vectors, 
coefficiem zig-zag patterns and dcquantization informatiocO 
are interspersed throughout the coded bit stream. 

To effectively receive the digital images, a decoder must 65 
recognize the control portions, extract the necessary control 
infoimaiion. and use the extracted data to process the video 



signal infonnaUou. One piece of information that is speci- 
fied for each sequence layer is the video buffering verifier 
(VBV) buffer size. The VBV buffer size value specifies a 
number of bits of input data from the video sequence which 
must be stored in the input buffer of the decoder before the 
video sequence may be decoded If this number of bits is 
stored when the decoding operation begins, the input buffer 
will neither become too fiill (overflow) or become empty 
(underflow) during the processing of the video sequence. 

The VBV buffer size vahie assumes that the input buffer 
is en^ty when the new sequence data is received or, at least 
that all of the data in die input buffer will be removed before 
the contents of the ii^t buffer reach the VBV bofifer size 
value. To ensure that the VBV buffer size value does not 
cause the input buffer to oveillow or underflow, it is pre- 
ferred in the MPEG standard that any image splidng be done 
on a sequence boundary. 

This may be unacceptable, however, for video editors who 
would like to switch from one scene to another afrer a 
particular picture has been displayed, irrespective of 
whether that picnure is at a sequence boundary. It may also 
be undesirable for broadcasters who wish to insert short 
program segments, for example station identification mes- 
sages or advertisemrats into an HDTV program at arbitrary 
intervals. 

If apBdng is not done at a sequence boundary then the 
data abeady resident in the input buffer may not be read 
firom the baStr for processing until the bufiisr overflows due 
to the new data from the inserted sequence. Altemadvely, the 
data ahea4y resident in the iiqmt buffer may cause the 
decoder to piematurely indicate that the VBV buffer size 
criterion has been met In this instance, the decoder may 
cause the input buff^ to either overflow or underflow in the 
processing of the stored data. 

One method of solving this problem is proposed in the 
MPEG-2 standard DIS ISO/IEC 13818-1. By this method, 
certain access units, or pictures, in the d^ stream are 
marked with a SEAMLESS_SPUCE_FLAG. This flag is 
used to maik safe locations for splicing an inserted sequence 
into the main sequence. As widi the conventional splicing 
method, however, there are only a limited number of access 
units which satisfy the criteria to have this fiag set Further- 
more, this splicing method limits the bit rate of the inserted 
stream to a cratain level to mett its criteria and the inserted 
stream can not be a variable bit nUe stream. 

Another method would be to define a fonnat within the 
MPEG standard whsxAi allows (or easy insertion and provide 
a flag identifying this fonnat. This method, however, cannot 
handle incompatible formats and reduces the robustness of 
the MPEG standard. 

SUMMARY OF TOE INVENTION 

The present invention is embodied in a method of pro- 
cessing a main MPEG encoded sequence to allow another 
sequence to be inserted at any picuire boundary in the main 
sequence. According to the present invention, the main and 
inserted MPEG sequences are analyzed to detnmine a 
number of stuf&ng characters to insert in the data stream 
after the selected picture boundary and before the inserted 
sequence. The stuf&ng characters are ignored during the 
decoding operation and allow the input buffer to be emptied 
to a level compatible with the inserted sequence. This 
number stuffing characters is detencmned fixim the data rates 
of the mahii and inserted sequences and flie intervals between 
respecdve poiats in dme corresponding to the start of the 
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insertion and the next decoding dme stamps in both the main 
and inserted sequences. The method inserts this number of 
stuffing characters after the selected splice point and then 
inserts the inserted sequence. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a data diagram which illustrates an insertion 
operation according to the present invcntioa 

FIGS, lasndlhaie graphs of buffer fullness versus time 
which are useful for explaining the operation of the present 
invention for fixed data rate MPEG-2 encoded signals. 

FIGS. 3a and 3fr axe graphs of buffer fullness versus time 
which axe usefiil fbr explaining the operation of the piesent 
invention for variaUe data xate MFEG-2 encoded signals. IS 

FIG. 4 is a block diagram of drcuitry suitable for use in 
an HDTV or MPEG-2 encoder and decoder which operates 
in accordance with the present invention. 

FIG. 5 is a flow-chart diagram of a process which extracts 
parameter values &om the nuun and inserted data stream. 

FIG. 6 is a flow-chart diagram of a process which calcu- 
lates a number of stuffing bits to be inserted fioxn the 
extracted parameters. 

FIG. 7 is a flow-chart diagram of an insertion process 23 
which inserts the number of stuffing bits calculated in FIG. 
6 between the insertion point between in main sequence and 
the start of the inserted sequence. 

FIGS. 7a, 7b and 7c are graphs of buffer fullness versus 
time which are useful for explaining the opoation of the 30 
present invention when the variable k, in FIG. 7, has a value 
of one. 
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FIG. 1 is a data diagram which illustrates the splicing 
operation. In this figures, a sequence 112 is inserted into a 
sequence HO of the mam HDTV signal to form a modiGed 
sequence 110'. As shown in FIG. 1, the main MPEG 
sequence 110 includes a sequence header 111, including a ^ 
sequence start code, several access units (pictures) 116 and 
a sequence end code 114. For the sake of simpHciQr, the 
group of pictures layer, which is between the sequence layer 
and the picture layer is not shown in FIG. 1. The sequence 
to be inserted, 112, also includes a sequence header 118, ^ 
several access units 122 and a sequence end code 120. 

As defined in the MFBG standard, eadi sequence stmt 
code may be preceded by a string of zero-valued stuffing 
bks. In the MPEG standrnd, these bits xeinesent null infor- 
mation which is ignored by the decoder and are not written 50 
into the input buffer. The stufiing bits are used to ensure that 
the rate at which data is being supplied matches the rate at 
which images, derived from the dam, are being displayed. 
While these stuffing bits are being received, the decoder is 
reading data irom the input buffer for display. Thus, the 53 
amount of data held in the input buffer is reduced while the 
stuffing bits are being received. 

The combined sequences are shown as the modified data 
stream 110' of FIG. 1. This data stream includes the 
sequence header 112, access units 116, a modified sequence tiO 
header 118' access units 122 and a modified sequence end 
code 120*. The modified sequence start code 119 includes a 
sequence end code, which marks the end of the first part of 
the previous main sequence, a number, NSTUFF, of stuffing 
bits, tbt sequence start code for the inserted sequence and 6S 
the modified header for the inserted sequence. Ttob bit-rate 
field of the original header for the inserted sequence is 



modified to be FFFF hexadecimal, indicating a variable 
bit-rate sequence. This change is made only if the bit rate of 
the inserted sequence is different from that of the main 
sequence and the original inserted sequence was a constant 
bit-rate sequence. 

The method according to the present invention splices the 
start of one sequence to an arbitrary access unit in another 
sequence. The insertion of the sequence is completed only 
after the remaining part of the original sequence is spliced to 
the inserted sequence in the same way that the inserted 
sequence was spliced to the main sequence. Thus, the 
modified sequence header 120' also includes a sequence end 
code, some stuffing bits and the modified sequence header 
for the main sequence. As with the modified sequence 
header US', the sequence header 120' may have its bit-rate 
field changed to FFFF hexadecimal, indicating a variable 
bit-rate sequence, if the bit-rates of the main and inserted 
sequences differ and if the original main sequence used a 
constant bit-rate. 

The number of stuffing bits to be added is determined by 
the method of the subject invention as described below with 
reference to FIGS. 5 and 6. Hie actual splicing operation is 
petformed as described below with reference to FIGS. 2, 3 
and 7. 

FIGS. 2a and 26 are graphs of buffer fullness versus time 
which illustrate the problem addressed by the present inven- 
tion and the method by which the problem is solved. The 
solid line in FIG. 2a shows part of the data stream for the 
main sequence, STREAMl, while the solid line in HG. 2b 
shows part of ib& data stream for the inserted sequence* 
STREAM2. In the exonplaxy embodiments of die invention, 
these data streams are bit-streams. Veitica] transitions in 
these Figures indicate times at whidi data is being read from 
the buffer. It is a convention in these types of diagrams Uiat 
data is modded as being read from the buffer instanta- 
neously. Portions of the curve which have slanted lines 
mdicate times at which data is being written into the buffen 
Hie slope of these lines is propoxtional to the data xate of the 
data stream. 

The sequence STREAM2 is to be insetted into the 
sequence STREAMl at time Tp immediately after access 
unit AUl. If the maximum input buffer size used by this 
example is 1000 then, if STREAM2 were inserted into 
STREAMl at time T^ then the buffer would overflow before 
the VBV buffer size (i.e. 500) for STREAM2 had been 
reached, lb preveiit this from occurring, the method accord- 
ing to the present invention inserts a number, NSTUFF, of 
stuffing bits between the AUl at time T, and the start of 
STREAM2. This is indicated by the dashed line in FIG. 2a. 
Thus, aiter T^* instead of following the solid line, the buffer 
fiiUness for the MFBG bit stream follows the dashed Ime. 
The vahies T^ DTSl, T,^ 13TS^ and DTS2 are used, 
as described below to calculate the optimal value for 
NSTUFF. While the stufiSiig bits are being inserted into tiie 
data stream, no new data is added to the buffa. New data, 
representing the inserted sequence is added when the slope 
of the dashed line is non-zero. 

It is noted, from PIGS, la and 2b that die rate at which 
data is provided by STREAM2 is less than the rate at which 
it is provided by STREAMl. Nonetheless, the first portion 
of the data of STREAM2, provided between tiie decoding 
time stamps DTSl to DTS^ is provided at the same rale 
as tiie sequence STREAMl while the portion of STREAM2 
which is provided after DTS^ is provided at the same rate 
as the original STREAM2, shown in FIG. 7h. • 

The graphs in FIGS . 2d and 22^ illustrate the qpenition of 
an exemplary embodiment of the inventive methcxl when the 
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sequences aie encoded to have a fixed data late. HGS. 3a 
and 3b illustrate the opeiatum of the method when die 
sequences aro enmded to have a variable data rate. Items in 
these Figures which conespond to items in FIGS. 2a and 2d 

arc indicated by a prime marie ("). 5 

FIG. 4 is a block diagram showing portions of an 
MPEG-2 or HDTV spUcer aud an MPEG-2 or HDTV 
decoder according to the present invention. Tte splicer 
includes a processor 412, which is coupled to receive the 
main and insert MFEG-2 HDTV signals, STREAMl and 
STREAM2. respectively. Each of these signals may be 
generated by a conventional HDTV encoder, such as is 
described in U.S. Pat No. 5,294,974 entitled, HIGH DEFI- 
NITION VIDEO ENCODING SYSTEM HAVING 
COLOR-SENSniVE QUANTIZATION, which is hereby ^ 
incoiporated by reference for its teaching on HCTV encod- 
ers. AUematively, these signals may be generated by an 
MPEG-2 encoder such as that described in ISO^IEC 13818-2 
DIS, which is hereby incorporated by reference for its 
teachings on MPEG-2 encoders. 20 

The processor 412 is coupled to two buffers, BStest 414 
and BSdcc 416. These buffers are preferably identical. Tbc 
buffer 414 is used to gather information from which the 
value NSTUFF is calculated. The actual splicing is per- 
formed using the buffer 416. The spliced signal is tiien ^ 
transmitted from buffer 416 to the input buffer 424 of the 
decoder 420. The decoder 420 also includes a processor 422 
which retrieves data from the input buffer 424 in order to 
reproduce a moving image. 

FIG. 5 is a flow-chart diagram which illustrates the 
pnicess that contiols the processor 412 in gatboring infiX'- 
mation about the sequences STREAMl and STItEAMl 
This process begrus at step 510. At step 512, the processor 
initializes the budfer 414 by setting its write address pointer 
to the beginning of the buffet At itcp 514, the processor 
sends STREAMl to the buffer at the data rate specified in 
the sequence header for STREAMl. It is noted that in the 
exemplary embodiment of tt£ invention, both STREAMl 
and STREAM2 are stored signals (e.g. recovered from ^ 
digital video tape recorders). Thus, the signals may be 
accessed twice, once to determine splicing parameters and 
again to perform the acmal splicing operation. For splicing 
two signals which arc not stored but come, for example, 
from a satellite feed, a compensating delay (not shown) may 
be needed so that the splicing parameters may be determined 
before the actual splicing operation occurs. 

At step 514, the process determines if the insertion point, 
immedi^y after the picture represented by access unit 
AUl has been stored into the buffer 414. Until AUl is so 
received, every access unit that is received, is removed from 
the buffer 414 at the time indicated by the deoodii^ time 
stamp (DTS) field of the access unit In other words, the data 
is removed bom the buff^ 414 in the same sequence and 
with the same tinditg that it would be removed from an input 55 
buffer by a decoder, such as the decoder 420 shown in FIG. 
4. Even when each access unit is removed, the sequence 
SlREAMl continues to be provided at its proper data rate, 
as indicated by step 520. and control is transfened to step 
516 to determine if AUl has been received ^ 

Once access unit AUl has been received, control transfers 
to step 522 to determine values for T^, and N^^,^ As shown 
in FIG. 2a, T^, is the difference in time between when AUl 
was received and DTSl, the decoding time stamp for AUl, 
thetimeat which AUl is to be read firom the mput buffer for es 
processing. N|^,, is a number of bits transfenred duxii^ the 
time interval T,B^ If STREAMl is a constant Ut-tate stream 



then N^, is simply the Tya, times the bit-rate. If STREAMl 
is a variable bit-iate stream, however, may be any 
number of bits less than the VBV buffer size. In a practical 
application whoe STREAMl is a variable bit-rate stream, 
N,„, may be T^^, times Rmax. wbeie Rmax is the maximum 
bit rate for the variable rate stream as long as N£„,*T|„, does 
not exceed the VBV buffer size. 

Next, at step 524, the process determines values for 
DTS««xri and N,^. DTS^ is the time to the next 
decoder time stamp after DTSl. In the MPEG standard, the 
decoder time stamps occur at regular intervals. Accordingly, 
DTS^ may be determined by calculating the difference 
between DTSl and the preceding decoder time stamp and 
then adding this difference to DTSl. Alternatively, this value 
may be determined by monitoring STREAMl, extracting 
the DTS values from the access unit headers which follow 
AUl until a DTS other than DTSl is encountered. As shown 
in FIG. 2a, Tnext is calculated by subtracting DTSl from 
DTS,^ Likewise, N„«„ the number of bits of data which 
will be stored into the buffer during the time interval T^, 
is calculated by multiplying T^ by the data rate, Rl, of 
STREAMl or by any rate which is less than or equal to the 
maximum data stream rate, Rmaxlp.l}, as defined in ISO/ 
lEC 1381 S-1 and ISO/IEC 13818-Z This data rate is avail- 
able friom the sequence header. If STREAMl is a variable 
rate data stream, as shown in FIG. 3a, Rl is any data rate 
which is less than or equal to the maximum data rate for the 
data stream, R^ [p.l]. as defined in ISO/IEC 13818-1 and 
ISQOEC 1381 S-2. 

At step 526, once these values have been deteooined, the 
process again empties the buffer 414 and, at step 528, begins 
storing data from S1REAM2 into buffer 414. This data is 
stored into the buffer at the bit rate of STREAM2. As shown 
by the loop including step 532, the data is stored until a time 
corresponding to the decoder time stamp for the first access 
unit of STREAM2. This tune is designated DTS2"'. The 
amount of data stored in buffer 414 at DTS2* is designated 
as N„^ and this value is saved by the process at step 534. 
At step 536, the process determines whether STREAM2 is 
a fixed rate stream or a variable mte stream. If it is a variable 
r^te stream, control is transferred to step 538 to determine a 
value R2, representing the bit rate of STREAM2. In this 
instance, R2 is assigned the average value of the data rates 
over the time interval defined by DTS2'. It is contemplated 
that R2 may be any rate between this average data rate and 
the maximum data rate allowed for STREAM2, as deter- 
mined from its sequence header. At step 540, the process of 
collecting the parameters ends. 

Afto* the parameters have been detennioed, the processor 
412 ralnilates the vahie NSTUFF. This process starts at step 
610 of HG. 6. At step 612, a tenqxffaiy variable K is set to 
zero. Next, step 614 calculates a value representing an 
amount of data which is to be written into the buffer having 
the data rate R2. 

In some splices, the amount of data represented by N„^ 
may not be able to be stored into the buffer, at the data rate 
Rl, during the lime interval T,^ This simation is handled 
by the loop which includes the steps 614, 616 and 618. At 
step 614, a trial value for N ^ is determined as the pnxiuct 
of K, and R2. At step 616. this trial value is compared 
to the quantity N,^ minus N^^^ minus N,^. 

If, however, N^^ is greater than or equal to minus 
}<tcm annus N„^ at step 616. then control is transferred to 
step 620 to determine the value of NSTUFF nccf?ntiTg to 
equation (1). 



(1) 
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At step 622, the process ends. The inventors have deter- 
mined that if this number of stuffing bits are added before the 
inseited sequence STREAM2, there will be no overflow of 
the input buffer when the data stream is received. 

After a suitable value of NSTUFF has been determined, 
the processor 412 executes the process shown in FIG. 7 to 
splice STREAM2 to STTiEAMl. This process begins at step 
710 by emptying the buffer BSdec, 416, shown in FIG. 4. At 
step 712, the processor 412 sends data ftom SlUEAMl into 
buffer 416 at the data rate of STREAMl, At step 714, the 
process determines if the last bit of AUl has been written 
into buffer 416. If not, the process continues to provide data 
from STREAMl until AUl has been stored as indicated by 
steps 716 and 718, removing any AU's prior to AUl at 
intervals conesponding to their decoder time stamps 
(DTS's). 

After AUl has been storcd, the process, at step 720 
removes any AU's in the buffer 416 which precede and 
include AUl at the corresponding decoding time stamp of 
each AU. Starting from the time that AUl has been stored, 
the process, at step 722 sends NSTUFF stufBng bits to buffer 20 
416 at the bit rate Rl. At step 724, the process determines if 
all NSTUFF of the stufling bits were sent before the time 
DTS,^,. If not, control transfers to step 734 which deter- 
mines if all NSTUFF of the stuffing bits were sent at the time 
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The embodiments described above use the interval 
between successive decoding time stamps as the mterval in 
which the amount of data in STREAMl and STEIEAM2 are 
measured. Alternatively, other time intervals may be used. In 
one alteniative embodiment, for example, the interval may 
be a frame interval and die number of bits provided in either 
STREAMl or STREAM2 may be the number of bits that are 
provided in a frame interval. For constant bit-rate streams, 
this number may be calculated as the bit-rate times the frame 
interval. For variable bit-rate streams, this number may be 
the maximum bit rate times the frame int^al. In this 
altonative embodiment, may be the number of bits 
provided in STREAMl during one frame interval; may 
be the number of Ints provided in STRfiAM2 during one 
frame interval, may be detennined as an integer, K. 
times 'tifujr VBhie for in this embodiment is the 
same as in the previous embodiment. Using dils sltonatlve 
embodiment, the amount of null information ((ht null time), 
NSTUFF, that needs to be Inserted into the bit-stream is 
defined by the equati(m (2). 



(2) 



In equation (2X K is an integer number that satisfies the 
DTS^'Siws'coni^^^^^ 25 ^f'lF^'T^J^'^i^^^'^'^^ 



send the remaining stuffing bits a: rate R2 to buffer 416. 

If, however, at step 724, it was detemiined that the 
NSTUFF stufEng bits had been sent before DTS^^o, step 726 
is executed which begins sending the initial part of 
STREAM2 to buffer 416 at bit-rate Rl. At step 728, the 30 
process detemUnes if the variable K has a value of zero. If 
not, control transfers to step 738 in which data from 
STREAM2 is sent to buffer 416 at the bit-rate R2. Step 738 
is also executed after step 734 if it is determined that 
NSTUFF bits have been sent at time DTS^ and after step 33 
736. After stsp 738, step 740 is executed which removes 
AU2 from buffer 416 at a time corresponding to DTS2. 

Although the embodiments described above have used 
stuffing bits as the null infonnation that is inseited between 
the spliced bit-streams, it is contemplated that other types of 40 
null inf (nmation, for example, null padc^, could be used in 
Eqppropriate circumstances. Alternatively codes that result 
"null time" may also be used. Hiese codes may, for example, 
temporarily suspend entering data into the VBY buffer. 
Whatever protocol is used, it is assumed that both the 45 
encoder and decoder operate according to the same protocol 
so that no information enters the VBV buffer duriqg the 
defined time period. 

FIGS. 7a, 7b and 7c are gr^hs of buffer fullness versus 
time which show a splice in which K has a value of one. In so 
FIG. 7c, it is noted that between the time indicated by 
DTS^ and the time indicated by DTS2, the bit rate is R2, 
the bit rate of STREAM2, if STREAM2 is a constant bit-rate 
sequence, and it is the average bit-rate during T2* (shown hi 
FIG. 7b) if STREAM2 is a variable bit-rate sequence. 53 

If, however, at step 728, it is determined that the variable 
K is equal to zero, then at step 730, first access unit of 
STREAM2, AU2, is removed from buffier. After step 730 or 
step 740, step 732 is executed which continues to provide 
data from STREAM2. at the bit-rate of STREAM2. This is 60 
the last step of the splicing process. 

As shown in FIG. 4, data is removed from buffer 416 and 
applied to the input buffer 424 of the decoder 420. The huffier 
424 ignores the stuffing bits, effectively delaying the appli- 
cation of the STREAM2 data until sufficient data has been 63 
removed from the input buffer 424, by the processor 422, to 
make room for the STREAM2 data. 



may depend on the two data streams that are being spliced. 
For example, if the two data streams are constant bit-rate 
streams having different rates, a larger value for K may be 
desirable to mf^intgin die constant bit rate for S1^EAM2. In 
addition, larger values of K may be desirable for some 
applications that need to maintain field parity consistency 
across the sequence boundary or that need longer time 
intervals to respond to changes in sequence header param- 
eters between STREAMl and STREAM2. One of ordinary 
skill in the art of editing MPEG bit-streams could readily 
determine suitable values of K for a particular application. 

While the invention has been described in terms of an 
exemplary embodiment, it is contemplated that it may be 
practiced as described above in accordance with the follow- 
ing claims. 
What is claimed: 

1. A method of splicing first and second data streams 
representing respective first and second encoded signals at a 
selected boundary in the first data stream using a buffer, 
wherein each of the first and second data streams has a 
plurality of decoding time stamps representing times at 
which data is retrieved from the buffer, the method com- 
prising the steps of: 

analyzing the first and second data streams to detennine 
an amount of null infcmnation to be inseited in the first 
data stream aflier the selected boundaiy, wherein The 
amount of null data is detomined from the decoding 
time stamps in the first and second data streams; 

transmitting the first data stream, up to the selected 
boundary to the buffer, 

transmitting the determined amount of null information to 
thebuffen 

transmioing the second data stream to the buffer; and 
retrieving the spliced data stream horn the buffer. 

2. A method according to claim 1, wherein the step of 
transmitting the second data stream to the buffer inchidcs the 
steps of: 

transmitting a first portion of the second data stteam to the 
buffer at the data rate of the first data stream; and 

tnmsnutting a second portion of the second data stream to 
the buffer at the data rate of the second data stream. 
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3. A method according to daim 2, wherdn the data 
streams are bit-streams encoded aocarding to a standard 
developed by the motion-pcture experts group (MPEG) and 
the amount of null informatiDn is a number of stuffing bits 
to be inserted before a sequmce start code of the second data s 
stream. 

4. A method according to claim 3, wherein the amount of 
null infonnadon is detennined by the equatiom 

where N^, represents a number of bits in ±e first data 
stream between the time that data following the 
selected boundary is stored into the buffer and the 
decoder time stamp at which the data following the 
selected boundary is retrieved from the memory; 
represents a number of bits of the first data stream that 
would be provided in an bterval between two decoder 
time stamps; N^^^ represents a number of bits of the 
first bit-stream that would be provided in an integer 
number of intervals between decoder time stamps of 20 
the first data stream, the number of bits being greater 
than or equal to N„^, the number of Uts m the second 
data stream occuning before the first decoder time 
stamp of the second data stream. 

5. A me&od accordiDg to claim 1 wherein the first and js 
second data streams are constant bit-rate data streams and 
the step of analyzing the first and second data streams to 
determine the amount of null data is responsive to the 
respective bit-rates of the first and second data streams. 

6. A method according to claim 1 wherein the first data 
stream is a constant bit-rate data stream and the second data ^ 
stream is a variable bit-rate data stream having a maximum 
bit-rate and the step of analyzing the first and second data 
streams to determine the amount of null data is responsive 

to the bit-rate of the first data stream and to die maxirnnm 
bit-rate of the second data stream. 35 

7. A method according to claim 1 wherein the first data 
stream is a variable bit-rate data stream having a maximum 
bit-rate and the second data stream is a constant bit-rate data 
stream and the step of analyzing the fint and second data 
streams to detenmne the amount of null data is responsive ^ 
to the maximum bit-xate of the first data stream and to the 
bit-rate of the second data stream. 

8. A method acconSiig to claim 1 wherein the first and 
second data streams are variable bit-rate data streams, each 
having a respective maTitnuin Ut-iate, and the step of *^ 
analyzing the first and second data streams to detennine the 
amount of null data is responsive to the respective mflKimum 
bit-rates of the first and seccmd data streams. 

9. A method according to claim 1 further including the 
steps of: SO 

analyzing the first data stream to detennine if the first data 
stream includes a sequence end code immediately 
before the selected boundary: and 

transmitting the sequence end code to the bu£fer after the „ 
first data stream is transmitted to ^le buffi^ when the 
first data stream does not include a sequence erid code 
immediately before the selected boundary. 

10. A method according to claim 1 fimber including the 
Steps of: ^ 

analyzing the second data stream to determine if die 
second data stream begins with a sequence start code; 
and 

transmitting the sequence start code to the buffer before 
the second stream is transmitted to the. buffer when the 65 
second data stream does not begin with a sequence start 
code. 
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11. A method of splicing first and second data streams 
represendng respective first and second encoded video sig- 
nals at a selected boundary in the Gist data stream using a 
buffer, wherdn each of die first and second video signals has 
a frame rate and wheredn the second data stream has at least 
one a decodiiig time stamp representing a time at which data 
is retriewd from the bufl^, the method comprising the steps 
of: 

analyzing the first and second data streams to determine 
an amount of null information to be inserted in die first 
data stream after the selected boundary, wherein The 
amount of null data is determined from the frame rates 
of the first and second video signals and the decoding 
time stamp of the and second data stream; 

transmitting the first data sueam, up to the selected 
boundary to the buffer; 

transmitting die detennined amount of null information to 
the buffer; 

transmitting the second data stream to the buffer; and 
retrieving the spliced data stream from the buffer. 

12. A method according to claim 11, wherein the amount 
of null information is determined by the equation: 

where represents a number of bits in the first data 
stream between the time that data following the 
selected boundary is stored into the buffer during a 
finme interval of the first video signal; Nnext ze;presents 
a number of bits of the seooiul data stream that would 
be provided in one frame interval of the second video 
signal; Nnew represents die nuinbw of bits in the 
second data stream occuxriAg before the decoder time 
stanof) of the second data stream and dw vahie of K is 
determined by the inequaKty K*N^^N^-^ft„p 

13. Apparatus for splicing first and second data streams 
representing respective first and second encoded signals at a 
selected boundary in the first data stream using a buffer, 
wherein each of the first and second data streams has a 
plurality of decoding time stamps lepresenting times at 
which data is retrieved from dw bu£6cr, the mediod com- 
prising the steps of: 

means for analyzing the first data stream to determine an 
amount of null information to be inserted in the first 
data stream after the selected boundary, wherein The 
amount of null data is detennined from the decoding 
time stamps in the first and second data streams; 

means for transmitting the first data stream, up to the 
selected boundary to the buffer; 

means for transmitting die detomined amount of mill 
information to the buffer; 

means for transmitting the second data stream to the 
buffer; and 

means for retrievhig die spliced data stream horn the 
buffer. 

14. Apparatus according to daim 13, wherein the first data 
stream has a constant data rate and the means for transmit- 
ting the second data stream to die buffer includes: 

means for transroittiiig a first portion of the second data 
stream to the buffer at the data rate of the first data 
stream; and 

means for transmitting a second portion of the second data 
stream to die buffer at a data rate detennmed from the 
second data stream. 

15. Apparatus according to claim 13 fuither coopisisg: 
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means for analyzing the first data stream to determiae if 
the first data stream includes a sequence end code 
immediately before the selected boundary; and 

means fOT transmitting the sequence end code to ttebufier s 
after the first data stream is transmitted to the buffer 
vihcn the first data stream does not include a sequence 
end code before the selected boimdaty. 
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16. Apparatus according to claim 13 further comprising: 
means for analyzing the second data stream to determine 

if the second data stream b^ins with a sequence start 

code; and 

means for transmitting the sequence start code to the 
buffer before the second stream is transmitted to the 
buffer when the second data stream does not begin with 
a sequence start code. 

* * * * * 
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